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1 . INTRODUCTION 

Random coefficient models and ordinary linear models with nonK^ussian 
marginal distributions have been developed for a variety of interesting 
situations in time series analysis to offer viable alternatives to the 
standard Gaussian assumptions (see Lewis, 1985, for a survey). Gastwirth and 
Wolff (1965) in an unpublished manuscript developed a stationary linear first 
order autoregressive process (i.e., one which satisfies the equation 
X^=pX^_j + e^, n>l; -Kp<l) with a Laplace marginal distribution for the X^*s 
(called LAR(l)). Independently Gaver and Lewis (1980) developed a linear 
AR(1) process satisfying the same process but with a Gamma marginal 
distribution, called GAR(l). Subsequently both of these processes have been 
shown to be special cases of more general discrete random coefficient 
autoregressive models (Dewald and Lewis, 1985 and Lawrance and Lewis, 1981 and 
1985). Other time series models using continuous random coefficients with a 
specified marginal distribution are, for Gamma distributions, due to Lewis 
(1981), Hugus (1982), and Lewis, McKenzie and Hugus (1989), and, with Beta 
distributions, due to McKenzie (1985). A first-order autoregressive process 
with the symmetric thick tailed hyperbolic secant distribution has been 
discussed by Rao and Johnson (1988). Nicholls and Quinn (1982) discuss 
general random coefficient autoregressive processes without reference to a 
particular marginal distribution. 

The Laplace LAR(l) model, and its generalizations to higher order 
correlation structures, was put forward by Dewald and Lewis, (1985) as a model 
where two-sided symmetrical random variables had larger kurtosis and longer 
tails than could be expected from Gaussian time series. A particular example 
is that of position errors in a large navigation system (Hsu, 1979) which were 
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found to have Laplace distributions. Again the N-S or E-W components of wind 
velocity data are often symmetric and long- tailed, especially in the tropics. 
For a summary of these applications Eind a summary of methods of generating 
non-normal time series, see Lewis (1985) and Dewald and Lewis (1985). 

Another application of the Laplace models arises when positive-valued 
Gamma time series are differenced to remove trends. The resulting marginal 
random variables are two-sided £ind result in the ^-Laplace family of 
distributions which we consider in this paper. 

In Section 2, we introduce this ^-Laplace family of distributions. These 
infinitely divisible, additive, symmetric distributions have extremely thick 
tails for small values of the paraimeter ^ eind approach a normal distribution 
as ^ increases. A square-root-Beta-Laplace trainsform is Introduced which 
allows us to transform one member of the ^-Laplace family into einother in a 
simple manner. 

Section 3 Introduces ^-Laplace processes with first order autoregressive 
structure. These are Markov processes with the geometric autocorrelation 
function which is typical of the Gaussiein, first order autoregressive (AR(1)) 
process. The basic structure is a random coefficient autoregression, and we 
generalize the structure of this model in Section 4 to encompass moving 
average (MA) eind mixed first-order autoregressive, qth-order moving average 
(ARMA) processes. Again, both the structure of the process and their 
autocorrelation functions mirror those of the Gaussian ARMA processes. We 
also briefly compare these processes with others which may be obtained by 
differencing the random coefficient Gaimma processes of Lewis. McKenzie and 
Hugus (1989). Finally, we show that a most important application of ^-Laplace 
processes lies in the modelling of differenced, possibly non-s tat ionary Gamma 
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processes . 

In Sections 4 and 5, we consider the very importeoit emd particular case 
5=1, i.e. the Laplace distribution. The first order autoregression, the 
l-BELAR(l) process, is discussed in some detail and pareuneter estimates and 
their properties are discussed and assessed both theoretically and using 
simulation. ' 

2. THE 5-LAPLACE FAMILY OF DISTRIBUTIONS 

2.1 5-Laplace Random Variables 

The probability density function of a Laplace distributed random 

variable, L, has two parameters a location parameter, < fx < + «“, emd a 

scale parameter, X > 0 so that 



We assume without loss of generality that p = 0 emd X = 1 throughout the 
remainder of this discussion. 

The characteristic function of the standard Laplace random variable 
(p = 0 and X = 1) is 



It is well-known that the standard Laplace distribution belongs to the class 
of infinitely divisible distributions. Thus 




-«> < X < + «. (2.1) 




-«> < (0 < + «>. (2.2) 
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e > 0, -«><(j< + <». (2.3) 



({^((0) = (l+u^) ^ 

is the characteristic function of a random variable. In fact it is the 
difference of two independent, identically distributed, i.i.d, Gamma(^,l) 
reuidom variables, where € is the shape parameter and 1 is the value of the 
scale parameter, k, of the G 2 unma' variable. If X has a characteristic function 
given by (2.3), then X is said to be an ^-Laplace reindom variable. 

Since (2.3) is real-valued in cj, X is a symmetric random variable. It is 
also easily verified that 



|b i f n i s odd , 

E(X”) = 

[_(k+l)j^{«)j^ if n = 2k. k=1.2 



(2.4) 



where (b)j^ = b(b+l) . . . (b+k-1) for b > 0. 

Thus, in particular, var(X) = 2S. From (2.4) we have 

E(X^) - [E(X)]-‘ ^ 3 ^ 3^,^ (2 5) 

[Var(X)r 

and the kurtosis approaches 3, as which corresponds to the kurtosis of a 

normal distribution. 

We note too that we are dealing with 3i\ additive family of infinitely 
divisible distributions, in the sense that the shape |>arELmeter is additive. 

In particular, if X and Y are independent ^j-Laplace and 

respectively, then X+Y is • This is easily verified using the 

characteristic function (2.3). Equally important is the obvious fact that X-Y 
is {S ^+€^)-La.pla.ce . Thus differencing keeps one in the same family of 
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distributions. 



2.2 The ^-Laplace Density 

Since X is the difference of two i.i.d. Gajnma(^,l) rtuidom variables, we 
can obtain the following density for X; 



fyCx.^) = S 



[ 



L(x) T^{€) S(g+x) 



1-e 

] exp{-(2g+x)}dg. 



( 2 . 6 ) 



where 



L(x) = Max(O.-x) (2.7) 

Now if ^ is a positive integer, (2.6) and (2.7) can be evaluated 

analytically. If ^ = 1, we obtain the density of the standard Laplace 

distribution. For i = 2, 3 and 4 the densities are also well-known 

derivations given, for example, as textbook problems in Feller (1971). Figure 

2.1 displays the densities for € = 1,2,3 and 4. Note how the graphs approach 

2 

the shape of a normal density with a = 2€ as € increases. 

When € is not an integer, (2.6) must be evaluated numerically. Figure 
(2.2) displays examples of ^-Laplace densities for non-integral i. Note that 
for ^ < 1, the density is not absolutely continuous at zero. In fact for 
i < 0.5, the density is infinite at zero. For 5 > .5 we have 

fx(o.«) = < «>. (2.8) 

For details on integrating (2.6) eind (2.7) numerically, see Dewald (1985). 
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i-LAPLACE DENSITIES FOR INTEGRAL T 

(STANDARD LAPLACE) 4-2 






Figure 2.1 Probability density functions of the ^-Laplace random variables 
when ^=1,2,3 eind 4. 
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i-LAPLACE DENSITIES FOR NON-INTEGRAL i 




Figure 2.2 Probability density functions of the fi-Laplace random variables 
when ^=0.25, ^=0.50. 5=0.75, 5=1.50. 
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2.3 The Square Root Beta-Laplace Transformation. 



Much of the sequel uses the square-root-Beta-Laplace transformation. By 
this technique, an ^^-Laplace random variable can be transformed into an 
^^“Laplace random variable, where ^2 ^ ^1* 



Theorem : Let X 5-Laplace and B Beta {Ba,Sa) where ^>0, 0<a<l,a eind 
a = 1 - a. It is assumed that X and B are independent. 

If Y = then Y (^a) -Laplace. 

Proof : By conditioning on B, we obtain the following expression for the 

characteristic function of Y: 

= E{exp(-iB^^^Ci))} 

= Eg[E{exp(-ib^^\x)}] 

= Eg[{l+bo)^)"^]. (2.9) 

Using the binomial expansion in (2.9) we have 



4V(<") = Eb 




2xk , k 
-w ) b 



( 2 . 10 ) 



Interchanging the expectation and summation in a convergent power series gives 



4v(<^) 



“ (^)k 2k k 

2 ^ (- 0 *^ E(B*"). 

k=0 



( 2 . 11 ) 



From Johnson eind Kotz (1970) we have, for integral k. 
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( 2 . 12 ) 



E(B^) = 

Substituting back into (2.11) completes the proof thus 

(^“)j^ 2 k 2 Sa 

4l^(w) = 2 = (l+0^“. (2.13) 

k=0 

3. THE «-BETA-LAPLACE FIRST-ORDER AITTOREGRESSIVE PROCESS. «-BELAR(l) 

The 5-Laplace raindom variable is not only infinitely divisible but also 
self-decomposable (Loeve, 1963). Thus a linear, constant coefficient 
autoregression can be defined, as was done in Gaver and Lewis (1980) for the 
first-order autoregressive process, GAR(l), in Gamma-distributed random 
variables. Moreover the innovation random variables are differences of 
independent Gamma ARl innovation random variables (Gaver and Lewis, 1980) £ind 
can therefore be generated by methods of Lawrance (1982) and McKenzie (1987). 

Unfortunately this linear 5-Laplace process has the same ’’zero-defect” as 
the Gamma GAR(l) process, which arises from the fact that the innovation 
random variable takes on the value 0 with positive probability, and this 
probability can be large if S is small and the lag-one corr relation, p(l), is 
large . 

For this reason we exploit, in this section, the square-root Beta-Laplace 
transform to define a different 2-parEimeter first-order autoregressive process 
in 5-Laplace variables. The first parameter, i, determines the non-Gaussian 
symmetric marginal distribution. The second parEumeter, a, given the value of 
£, determines uniquely the lag-one serial correlation. Since the random 
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coefficient model is shown to be first-order Markovian, a determines the 
entire autocorrelation function up to the sign. The process does not have the 
same ’’zero-defect” as the linear model. 

We define the stationary process {X^(^)} by means of an additive, random 
coefficient equation- 

I 

+ B^^^^(ea.ea) L^(«). (3.1) 

where {A^{€a,€a)) is an i.i.d. sequence of Beta(^a,^a) r.v.’s; {B^(^a,^a)} is 
an i.i.d. sequence of Beta(^a.^a) random variables, independent of 
{A^(^a.^a)}, and {L^(^)} is an i.i.d. sequence, independent of both 
coefficient sequences, of ^-Laplace r.v.’s. Coefficient and innovation 
sequences are all assumed to be independent of for all k ^ n-1. The 

process {X^(5)} so defined will be called the ^-Beta-Lap lace AR(1) process . 
^-BELAR(l). 

If it is assumed that has an ^-Laplace distribution, then by the 

theorem in Section 2.3 and the additivity of the ^-Laplace family, so does 
X^(^). The fact that the process is Markovian follows by construction. It is 
also explicitly autoregressive. To start the process in the stationary 
distribution, set Xq(^) = Lq(^). Note also that the parameter space for the 
process is the set {(^,a)|^>0, 

0 i a i 1}. 

For the Beta random variables A and B to be defined properly, each of 
their parameters must be positive. However, when a = 0 or a = 1 , (3.1) is no 
longer appropriate. Therefore it is understood that if a = 0 then is 

identically zero and {B^} is identically one. Thus a = 0 implies 
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X^(5) = L^(^) said {X^(5)} is eui i.i.d. sequence of ^-Laplace variables. For 
convenience, we denote the innovation process in (3.1) by . i-e- 

^n = \^^h^a.ea)Lje). (3.2) 

Examples of sample path behavior 'for selected 2 and a are given in Figure 3.1. 
Note that although the correlation coefficient is approximately 0.8 for all 
sets of € and a, there are considerable differences in the sample path 
behaviors as 2 changes. In particular when 2 is small there are runs of 
values that are very nearly zero in magnitude, so that the process looks very 
sporadic. Wind velocity data, especially in the tropics, tends to be of this 
form. Using (3.1) we obtain 

p(l) = Corr{X^(«),X^_j(«)} = E{A^^^^(ea.€a)} 

_ ar(ea+i/2)r(e+i) 

~ r(e+i/2) r(«a+i) 

Note that as a-» 1 , then p(l)-» 1. Similarly as a-* 0, p(l)-» 0. We csui show 
that (3.4) yields the full range of positive correlations in a one-to-one 
function of a for any given value of 6. Further, it is easily established, 
using (3.1), that 

p(r) = Corr(X^(«),X^_^(«)) = p(l)l''l, r = 0,± 1,...(3.5) 

Note also that except at ^ = 0, p(l) ^ a. Since we shall frequently 
refer to expressions of the form of (3.4), we define the notation 



(3.3) 

(3.4) 
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CUTA &4lA 



I 



i-BETA-LAPLACE AR(1): 



SAMPLE PATHS 



a*.7U-l ,p<l)*- OOSSS 




•« 07as.i«. io>»(i}- ao4S 




•- 54.l-.75Xl)- 60425 •-.11.1- 25X0- ^223 






Figure 3.1 Sample path behaviour for ^-Beta-Lap lace processes for fixed lag- 
one serial correlation of 0.8, and different values of 
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TC^a) = E{[Beta(^a.«a)]^^^}. 



(3.6) 



We noted above that the process is explicitly autoregressive. It is 

autoregressive as well in the sense of expectations (Lawrance and Lewis, 1987) 

in that E(X^(«)|X^_j(fi) = x) is a 1 inear function of x. Further, replacing 
1/2 1/2 

(.) by -A^ (.) in (3.1) yields the full range of negative correlations. 

Explicit expressions are very difficult to obtain for joint distributions 

of consecutive observations in the ^-BELAR(l) process for general i. Later, 

we consider in more detail the very important and more tractable case of the 

Laplace distribution, i.e. ^ = 1. Here, however, we briefly note some 

aspects of one of the important properties of such joint distributions, viz. 

time reversibility. A process, • is time-reversible if the joint 

distributions of (X ,X X , ) euid (X . ,X , X ) are identical for 

' n n+1 n+r-' ^ n+r n+r-1 n'' 

all r and n. This is an important property in practice in the identification 

problem. However, it is a property of the joint distributions and these are 

not known. Nevertheless, we can demonstrate partial time reversibility with 

respect to both directional moments and runs probabilities. 

It is straightforward to verify from (3.1) that E(X^ ^n-k^ ~ ^^^n^n-k^ ~ 

0 for all n euid k. Thus, (X^(£)} given by (3.1) is time-reversible with 

respect to these directional moments. Further, the characteristic function of 

X - X , is given by 
n n-1 ^ 



E{exp[-i(o(X^-X^_j)]) = (1 + </) E^([1+(1-A^^2j2^2^ 

and this is clearly real valued. Thus, X^ - X^_^ is symmetric about zero and 
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so P(X^ > ^n-1^ ” ^ reversible with respect 

to runs probabilities. 

4. THE ^-BETA-LAPLACE ARMA PROCESSES 

4.1 Introduction ‘ 

In this section, we introduce time series models that have ^-Laplace 
marginal distributions and the correlation structure of the linear, Gaussiain, 
ARMA processes, although the order of the autoregression is limited to p=l . 

As before, our constructions are based on the square-root Beta-Laplace 
transform and the additivity of the ^-Laplace family. We begin by considering 
pure moving average processes. 

4.2 The first order moving average process, ^-BELMA(l). 

Let {L^(0)} be an i.i.d. sequence of 0-Laplace random variables, where 
0 = ^/(1+P) and 0 < /3 < 1. Let /3 = 1-p. Also let {C^{0/3,0/3)} be an i.i.d. 
sequence of Beta(0/3, 0/3) variates independent of {L^{0)}. Then the process 
{X^(^)} generated by 



XJ€) = Lje) + C^^^(e/3.0P)L^_j(0) (4.1) 

has a marginal ^-Laplace distribution 2 ind an MA(1) structure with 
0 i Corr{X^,X^_j) i 0.5, as shown below. 

The marginal distribution of {X^(^)} follows directly from the square 
root Beta-Laplace transform and the additivity of the ^-Laplace family. 
Further, the construction of (4.1) defines (X^(^)} as a reindom coefficient 
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moving average of order one. Thus. and are, by construction, 

independent for |k| 2 2. In addition, we may easily verify from (4.1) that 



Pj^(l) = Corr(X^.X^_j) = nr(e/3)/(l+P) . (4.2) 



where nr is defined by (3.6). Writing out (4.2) explicitly yields 



_g_ r(pe+i/2)r(9+i) 

^x^ ^ “ i+p * r(pe+i)r( 0+1/2)' 



(4.3) 



Thus, as P“» 0 we have Pj^(l)-^ 0, and as |3-» 1 we have Pj^(l)-» 0.5. We may show 

that Pjj(l) is a one-to-one function of p extending over the full positive 

range of correlation for a moving average process of order one, MA(1), namely 

1/2 1/2 

[0,0.5]. In addition, replacing by -C^ yields the full negative range 

[-0.5,0]. Thus, the entire rtuige of possible values of Pjj(l) ior an MA(1) is 
available for this model. This is important in practice, relating as it does 
to the applicability of the model. The NLMA(l) model of Dewald (1985), which 
is a MA(1) model with Laplace marginals has, in contrast, p(l) bounded by ± 
0.4026. 

It is straightforward to show that this model, like the autoregressive 
model ^-BELAR(l), is time reversible with respect to runs probabilities. 

4.3 Higher order moving average processes, the ^-BELMA(q) process. 

The process defined by (4.1) may be extended to order q as follows. Let 
{L^(0)} be, as before, an i.i.d. sequence of 0-Laplace random variables, where 

q 

now 0 = €/(l+2 p.) 2 ind 0 < P .< 1 . for i = 1,2 q. Also let 

i=l ^ ^ 

(C^ ^(6P^,6P^) , i = 1,2 q) be independent sequences of i.i.d. 
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Beta(GPj ,0/3j) random variables independent of (L^(0)}. Then, the process 
{X^(^)} generated by 



x„(«) = L„( 0 ) (ep^.epj,L^_^(e) (4.4) 

I 

has a marginal ^-Laplace distribution and MA(q) structure. These properties 
follow in the usual way. As regards the autocorrelation function {Pj^(k)}, it 
is clear that Pj^(k) = 0 for |k|>q. and we can show that 

Px(k) = ^(ePj^) nr(0/3^)nr(0/3^^j^)}/{U 2 /3^}. k=l,2 q.(4.5) 

i=l i=l 

It is interesting to note that although {pj^(k)} is similar in form to the 
autocorrelation function of a Gaussian linear MA(q) process, the correlations 
are not identical. 

This q-th order moving average process, too, is time-reversible with 
respect to runs probabilities. 

4.4. The first order mixed autoregressive moving average process, 
«-BELARMA(l,l). 

The first order mixed model is obtained by defining the process 
{Xn(^)} by means of two first order difference equations, one corresponding to 
the autoregressive (AR) component and the other to the moving average (MA) 
component. These are respectively* 

= C ^ B^^^(0a.0a) L^{0) (4.6) 
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and 



(4.7) 



= L^(0) + (OP.ep) Y^_j(0). 

where 0 = «/(!+/?): 0 < a. /3 < 1; and {L^(0)>. {A^(0a.0a)}. (B^(0a.0a)} and 
{C^(0P,0P)} are independent sequences of i.i.d. random variates with the usual 
distributions signified by this nbtation. As before, we may show that (X^(^)} 
is marginally 5-Laplace and has the autocorrelation function of an ARMA(l.l) 
process. In particular, 

p^{k) = ^ ^ j 2 ,4.8) 

Note that this process (X^(^)} has a structure which is determined in a simple 
way by the two parameters a and /3. If P = 0, we have the 5-BELAR (1) process, 
and if a = 0 the process reduces to the 5-BELMA(l) process. Further, if a = /3 
= 0 then {X^(5)} is a sequence of i.i.d. ^-Laplace variates. 

4.5 Other 5-Laplace ARMA processes 

We can extend the models described in the previous sections to an ARMA 
(l.q) form. This is achieved by replacing (4.7) by ein expression similar to 
(4.4) but involving L , L ,,..., L , and Y . However, nothing new 
emerges here and so we consider insteeui some other ^-Laplace processes 
generated as the differences between Gaimma processes. 

(i) Independent Gamma processes. 

Suppose that {X^} and {Y^} are independent Geunma processes with 
Gaimma(5,l) marginal distributions and identical ARMA structures. Consider the 
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process {Z^} given by - Y^. As noted in Section 2, the marginal 

distribution of {Z^} is ^-Laplace and the process shares the same 
autocorrelation function as {X } and {Y }. On the other hand, {Z ) is not 
structurally the same as these two processes. Thus, this approach allows us 
to construct i-Laplace processes with ARMA autocorrelation functions but not 
the simple linear additive, randbm coefficient ARMA structure of the ^-BELARMA 
processes . 

(ii) Serial differences in the BGARMA processes. 

A feature of the BGARMA processes of Lewis, McKenzie and Hugus (1989) 
which is relevant here is that the first order AR and MA processes, BGAR(l) 

Slid BGMA(l), have the same form of bivariate distribution for two consecutive 
observations. If the BGAR(l) or BGMA(l) process is and is marginally 

Gamma(i,l), the joint characteristic function of X^ and is 

<#>X X ” (1+lu) (1+iu) (l-flu+iu) 

n’ n-1 

where p = corr both processes, and p = 1-p. Now, the process of 

first differences, AX^ = marginal distribution given by the 

characteristic function 

= <#>x X = (1+u^) 

n* n-1 

Thus. is marginally (5p)-Laplace. Furthermore, if {X^} ~ BGMA(l) 

originally, then {^X^} Is an (^p)-Laplace with MA(2) correlation structure. 

In fact. = -(l-2p)/2(l-p) and P^^(2) = -p/2(l-p). If {X^^} ~ BGAR(l) 
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originally, then {AX^} is an (^p)-Laplace process with ARMA(l.l) correlation 

1 k-1 

structure. In this case, P^(k) = ” 2 , k ^ 1. Again, these first 

differences processes do not have the simple ARMA structure of the processes 
presented earlier, although they may share their marginal distributions and 
autocorrelation functions. 



4.6. The ^-Laplace ARIMA processes 

In the practical application of the Gaussian ARMA processes it has been 
found extremely useful to extend the basic models to processes {X^} which are 
non- stationary but whose first (or higher order) differences are an ARMA 
process. Such processes are called integrated ARMA processes and we refer to 
such an {X^} as an ARIMA process. This is a trivial extension mathematically, 
but it would be difficult to overestimate the extra range of applicability it 
bestows in practice to time series models. The approach is discussed in 
detail by Box and Jenkins (1976) and has been found enormously useful. 

Defining integrated processes presents no problems for Gaussian processes 
which retain their marginal distributions under simple linear transformations, 
even of dependent data. However, if a non- stationary time series is thought 
to be marginally Gamma it is by no means clear just how its differences might 
be distributed. We have detailed a number of occasions here in which 
differenced Gammas have the i-Laplace distribution and we would argue that it 
is not unreasonable to assume that they will often be so in practice, at least 
approximately. Thus, in attempting to model a non- stationary Gamma process 
whose differences seem stationary, we would consider modelling the differenced 
process as an ^-Laplace ARMA process. We would thus argue that such 5-Laplace 
ARIMA processes are potentially of great practical importance. 
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5. THE FIRST-ORDER BETA-LAPLACE AUTOREGRESSIVE PROCESSES. l-BELAR(l) 



5.1 Construction and Correlation Structure 

In this section we will study in detail the first-order ^-Beta Laplace 
process with i = 1 (i.e., l-BELAR(l)), This process is far more tractable 
than the general case, and is an interesting alternative to the autoregressive 
NLAR(l) process introduced by Dewald and Lewis (1985). Thus we set £ - 1 in 

(3.1) to obtain 



where is i.i.d. sequence with (1 -a) -Lap lace. Also i^s a 

marginal distribution that is standard Laplace. 

The only parameter in the model is a, which describes the dependency 
structure of the process, as given by (3.4) and (3.5), when ^ = 1, as 



forr=0, ±1, ±2,...* 

Now there are infinitely many other first-order AR(1) processes with 
identical autocorrelation functions nnd standard Laplace marginals, in 
particular the NLAR(l) processes by Dewald and Lewis (1985). Dewald (1985) 
developed fourth-order emalyses of the NLAR(l) model based on the linearized 
residual , 




(5.1) 




(5.2) 



20 



(5.3) 



R = X - 
n n 






to differentiate between different parametric cases of the model. The use of 
higher-order residual analysis in reindom coefficient processes was established 
by Lawrance and Lewis (1987). We use (5.3) again in Section 6. 

I 

5.2. The Conditional Density of X^, given = y- 

To find the conditional density of = Y- we begin by deriving the 

1/2 2 
density of (a,l-a) by differentiating P(A^ < a ) with respect to a'- 



2a-l 



^l/2(a:a) - ’ 



0 < a < 1. 



(5.4) 



1/2 

To evaluate P{X < x I X i = y} we condition on A (a,l-a) thus: 
^ n ' n-1 n ' 



P{X < X I X , = y } = PfA^'"^ X ,+e <x|X ,=y} 

^ n ' n-1 ^ n n-1 n ' n-1 

= ^, 1/2 

A n 

n 

L2(x) 

= S ^ (x-ay) f . „(a;a)da. (5.5) 

Lj(x) ^n A^^^ 



where F^(x-ay) is the cummulative distribution function of the ( l-a)-Laplace 
random variable, and L.(x), for i = 1,2, are the limits of integration on 
a, which may be functions of x. 

Since F (x-ay) changes definition for negative and positive values of 
n 

(x-ay) and since 0 < a < 1, differentiating (5.5) with respect to x gives two 
branches for the conditional density as 
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a=l 

S f (x-ay;l-a)f 
a=0 



A 



l/2(a;a)da 



x/y ^ 1 or 
x/y i 0 



n 




a=x/y 

S f (x-ay:l-a) f 
a=0, 



A 






(5.6) 



n 



a=l 

X 

a=x/y 



(x-ay;l-a)f 



n 



A 



n 



1/2 0<x/y<l. 



Now (.;l-a) can be evaluated from (2.6) Eind f {•:!"«) from (5.4). The 



equation (5.6) is computed numerically, as given in Dewald (1985). 

Note that (5.6), as a function of x, is not absolutely continuous. In 
fact if a ^ 1/2 and x = y, the conditional density is not defined. 

We use (5.6) in obtaining the maiximum likelihood estimates of serial 
correlations through the parameter a. This is discussed in Section 6. 

6. ESTIMATION OF SERIAL CORRELATION IN l-BELAR(l) 

6.1 Least-Squares Estimation of p(l) 

Although the l-BELAR(l) process is not a linear process (except when 

a = 0) the linearized residual is formed as in (5.3). The process 

shown by Lawreince and Lewis (1987), is uncorrelated but not independent. Also 

it can be seen that conditional on X that R has zero mean and variance 

n-1 n 

2 

2{l-(p(l)) }. Therefore a conditional least-squares estimator (Nicholls and 



Quinn, 1982) of p(l), p^^ ceui be derived by minimizing the sum of squares of 



n 



A 



n 
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R with respect to p(l). This produces the usual product moment estimator 
n 






Pls 



n 



= 2 x.x 
i=2 ' 



i-1 



n 

/ 2 

1=2 



2 

i-1 



( 6 . 1 ) 



Now Dewald (1985) showed that the l-BELAR(l) process is a Raindom 

I 

Coefficient Autoregressive (RCA(l)) process in the sense of Nicholls and Quinn 

^ /s 

(1982). Therefore from Theorem 3.1 of Nicholls and Quinn, P| s~*P(l) » 2 tnd 
is asymptotically unbiased and normally distributed, with asymptotic variance 
given by 



nVar(^j^) = 1 + 5a - 6[p(l)]^. (6.2) 

/\ 

Simulations of Pj^ were conducted for selected values of p(l) in the 
l-BELAR(l) process using the Simulation Testbed (SIMTBED) of Lewis ejt al . 
(1984). Detailed tabulations of the distribution of are given in Dewald 
(1985) for various values of a eind different sEumple sizes. 

Dewald (1985) also showed via simulation that certain robust estimators 
based on symmetric loss functions of R^, other than the sum of squares, are 
biased and apparently asymptotically biased. These robust estimators include 
the Huber (c), rank, and least absolute deviation (LAD) estimators of p(l). 

Note that these results for robust estimators are different in the l-BELAR(l) 
process than in the linear AR(1) processes for which these estimators are 
reported to be consistent and asymptotically unbiased, e.g. Denby and Martin 
(1979) and Bloomfield and Steiger (1983). 

The least-squares estimator, is used in the next subsection as a 

starting value in an iterative procedure to find the maximum likelihood 



23 



estimator, Pjjjj-. of p(l). 



6.2 Maximum Likelihood Estimation 

The maximum likelihood estimate of p(l) can be obtained from the 

conditional density in (5.6). The formula for the Joint density of X^. 

, X, is 

n-1 1 



^^^n*^n-l ^1^ “ ^X |X /’^nl^n-l^^X , |X „^^n-l l^^n-2^ ‘ * ^X, ^^1^ * 

n* n-1 n-1' n-2 1 

where (x. ) is a standard Laplace density. 

Xi 1 

y\ 

Dewald (1985) used (6.3) to obtain estimates for a and then computed p«t ^ 

nlJb 

from the one-to-one function of a in (5.2). The least-squares estimate served 



as a good starting point for the numerical evaluations to find p . 

Techniques for the numerical integration and search for this estimation 
procedure are given in Dewald (1985). 



The simulation results in Dewald (1985) indicate that p^ ^ has a smaller 
standard deviation aind bias than does p^^ at all values of p(l). Some 
particular results are: 

(1) For a sample size of n = 175, eind a = 0.5, so that p(l) = 0.6366, 

the correlation between the two estimates is estimated to be 0.393. 

The estimated standard deviation of p. ^ is 0.0728 and that of p.„r- 

LS '^MLE 

is 0.0289. 

(2) For a sample size of n = 125, eind a = .11, so that 

p(l) = .1922, the correlation between the two estimates is estimated 
to be 0.843. The estimated staindard deviation of Pj^ is 0.099 and 
that of Pjjle 0.069. 

(3) For a sample size of n = 250, euid a = 0.844, so that 
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p(l) = -0.900, the correlation between the two estimates is 
estimated to be 0.101. The estimated standard deviation of p, ^ is 
0.030 and that of p^^ p is 0.006. 

The number of replications in this simulation was only 20, so the results 
are imprecise. However, it is clear that the maximum likelihood estimator of 
p(l) is better than the least sqxiares estimator, but the computation of the 
maximum likelihood estimator is not simple. 

Dewald (1985) also gives results on joint estimates of p(l), E(X^) and 
Var(X^) in the l-BELAR(l) process. 

Also one should note that while the least-squares estimator of a and p(l) 
is available for the general £-BELAR(l) process, maximum likelihood estimation 
of a and p(l) is intractable unless € = 1. 
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